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FIBRE CHANNEL SWITCHING FABRIC 



The present mvenuon relates to ,np v ^.^ 
. . ,,»«,fimital switch which switches Fibre cnanneiirdi 
more particularly to a digital s ^^^^^ ^. ^ ^^^^^ 

speeds of up to at least one gigabit p.r second 

A common .imiting factor m computer system p 

rrpin to Storage, or the l/u pam. i 

,L. POO, ^ - r.-o 
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F<»„h. Fib,. Ch,™, fi«. ""^ '"^ 

F»U,.c.b.«. Simple a«HWic.«,.^l«s>»"» 
„pi«rc.t,tewlilisinain.gM«lgMfil«'0|nicc.bl«. 

atuches a device directly to a fabric. 

A F*,e Cb««l 6*nc b » e«i, --icb »*b» b»«.n c«»»»d 

Fabnc i. . won. *h » sy»»„~« --I- « ™«"- 

is noi available. vi^^*. 
B«.» high m Fibre Ch.n«. fbric, 

„,.„ion n«»o,K s,.i.<s ««io.. M - 

Fib«Cbann.l. 
1 Rouie daennination in i«™0« 

:;LLup,oo»gig*»P.r»c»«.»^i«-'«c»-««'-»'^ 

, „J,.*,oprcc»o«-*^-'""'''-™«'^""'^°'"'°™* 
frames with a link speed of 1 gigabit per second. 

frameswitnai v „,„f„r«Mems In Fibre Channel fabrics 

Frame validation creates another set of problems, inr 

K ^rfnrmM at taics UP to onc huudted times faster than m 
frame validation must be performed at rates up lu 

Ethernet switches. ft,„cuon which must be perfom«d in real 

1ft Statistics collection is also another function wnicn 

^ A e ,Ahy, the Fibre Channel fabric Management 
time. Statistics collected are defined by the note u 
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[ntbnnation Base ,MIB) and include the number of frames transmitted and received, 
ihe number of labric rejects and fabric busks transmuted and received, etc. 
Catherine siatistics for sixteen one g.gabi. per second ports creates new challenges. 

Current fabric realizations use either fast microprocessors or digital signal 
processors to perform Uie route determination functions. Typically, processors are 
single instruction devices whicn senally decode the instructions and perform .he 
specifted t^nction. Digital signal processors contain parallel functions and can 
perform several tunctions at one time. Still the problem exisu to determine the route 
,or many simultaneous incoming frames at one gigabit per second. Current fabnc 
.mplementations perform routing on the order of tens of microseconds to hundreds of 
milltseconds. Ideally, routing should be accomplished in less than one microsecond. 

problem wi* fabric realization is the support of the Arbitrated Loop 
topology, m topology has unique Characteristics and requirements. Current fabnc . 

implementations do not suppon this topology. 

Efficient support of bothcom^ction based classes of service (i.e.. Class I) ^ 
connectionless classes of service (i.e.. Ca. 2 and 3) is also a challenge. A fabnc 
must implement a different type of sw.tch core to implement each Cass of serv.ce. 
coordination between the different switch cores can be a burdensome tas.. Current 
t.bric unplementations sup^rt either a connection based or a connectionless swttch 
.ore This leads to inefficiencies, e.g.. a connectionless switch core cannot swttch 
Class 1 trafftc if routes are not determined in frame time (i.e.. less than one 

..crosecond) and a connection switch core is very inefftcient when routing Class 2 

and Class 3 iraftlc. 

Another problem with fabnc realization is the interconnection or networkmg 
of fabrics. This is a problem due to the high speeds involved. Determtmng a 
network route ts somettmes even more difficult than determining a local route. 
Destination addresses must be matched based not only on all bits matchmg but also 
matching a ponion of the address. Route priorities should also be implemented to 
allow baclcup routes to a destination. 
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5innn-in' ^f^p invention . . ^ 

The present invention described and disclosed herein cor«pr.ses a mefliod and 
apparatt. for transporting Fibre Channel frames between atuched device. The 
apparatus compr.ses logic which supports but is noc limited to .he following feamres: 
Transport ofCass I. Class 2 and Class 2 frames. Support for the Arbitrated Loop 
.opology on each link. Support for Fabric point-toi^in. topology on each linlc. Route 
aetennination in frame arrival time, and Interconnection or Networlcing of Fabncs 
in one aspect of the invention, the apparams comprises separate port control 
.odu.es. oneforeachattacheddevlce.ace„tral router modu,e,aswitchcore module^ 

a fabric control module and a brouter (bridge/router) module. In the preferr«l 
embodiment, the port control modules are connected to the router modu^^s by 
separaterouterec^^estconnectionsandseparaterouteresponseconnecu^^^ 
I strucn^re. route requests may be provided from the port control module to the 
router while simultaneously the router provides route request responses to *e «tme 
portcontrolmodule. P^ferably. a common route request channel U utUtzed. Tin., 
^paranas-tsprov-ded to returnarouterespo^toapreviously requiting port wj^^ 
Iportsarearbitratingand sending routereqt^^stothecentndizedrouter. More 
l^ly. this apparatus provides for readi^ resource requests from muluple 
testers while at the san« .in« remr^ng resource grant respo^ » prevtous 
20 requester. ^^^^ ^^^^ ^^^^^^ ^^^^^ 

the preferred embodiment, the router Includes multiple st.te machines arranged « 

ll^p^lh^operati^t. Specil^Iy. in d« preferred embC^ent o the route 

sctiw I F t~ renuest and a hardware finite 

a hardware fmite state machine operates on the route request ana 

^ ...n^hlneprovidestherouterespo^e. Thus, in *is embodiment, t^e router 
incudes an input for receiving the output Of the route request generator of the port 
eontrolmodule.anoutputforsendingarou«requestrespo^to.er.terequ«^ 
.espor^e receiver in the port control module, a hardware fmite state machtne . 
receive the route request, and a hardware finite state machine to provide the route 
,0 respor««.incombinatio„wi.haroutedeterminationsystem. Through implementauon 
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.„ hardware, rou.e responses may be n.aUe in less rhan iwo microseconds, wh.ch 
rcrmiis essentially real-lime routing at gigahertz frequencies. 

,n yet another aspect of the router, ic routes Fibre Channel frames .0 a 
destinatton port on the Fabric bas^ on a selected portion of the incoming frame s 
desunation address. In the prefened embodiment. Fibre Channel FCPH protocol 
. ules are applied ,o an incoming frame to determine whether to route the frame or 
return a tabnc reject or busy frames or to discard the frame. Validation ot the 
routin- of a Fibre Charmel frame is based on the rules defined in the ANSI FCPH 
sundaids. m the preferred embodiment, route requests are serviced in a round rob.n 
manner from muUipic ports. 

in another embodiment an apparams and method is provided to store blocked 
route requests until either the blocking condition resolves itself or a spec.f^d tune 
period expires. Tl.us. a method for servicing route request from multiple attached 
devices where *e routing is -subject to blocked and unblocked conditions may be 
effective, where the method comprises the steps of servicir^g a route request whtch ts 
tlocked. but saving a blocked route request in hardware, preferably in reg s^ 
and then servicing that requestif the routechangesfromablocked to an unblocked 

condUion. in the preferred embodunent. pnor to the expiration of a spectf^^d tmte 
period, in a more general sense, the invention maruges the blocking atKl unb.ock.ng 
^0 of multiple resource requests to a central resource. 

in another embodtmem an apparams ts provided to handle the scenarto when 
. port .nput flfo is going to overflow with an incoming Fibre Channel frame. 
Generally, the incoming daut stream is typically provided to an encoder/decoder, from 
.hichitissuppliedtoabuffer. ,„*eeve« of a data overrun condition to the buffer, 
overrun prevention logic causes the setting of tag bits to a condition whtch may be 
recoonized downstream as indicative of a buffer overflow condttton. 

' In another embodiment an apparatus is provided to interleave accesses by the 

. k..c m between outeoing frames or when the output 
processor on the outgomg port bus m between ouigoing 

flfo is full. 
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In another embodiment an apparatus is provided to pack requests in a register 
array In order of first arrival but allow the ^raoval of the leqiicsts frorti anywhere in 
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the array. 

^HwHof'^^ Invention 
5 It is an object of this invention to provide a fibre channel fabric capable of 

operating at ai least 1 gigabit speeds. 

It is yet a liitther object of this invention to permit the esublishment of a path 

through a fabric in real time at gigabit speeds. 

It is yet a further object of this invention to provide 1 microsecond or less 
10 response time to fibre channel frames. 

It is another object of this invention to determine in teal time ai gigabit speeds 
that no through path can be established through the fabric. 

It is yet another object of this invention to provide a fibre channel fabric 
capable of simultaneously supporting Class I. Class 2 and Class 3 service. 

It is an object of this invention to provide a fibre channel switching fabnc 

which supports arbitrated loop topology. 

It is yet another object of this invention to provide systems and methods 

adapted for interconnection of multiple fabrics. 

It is yet another object of this invention to provide a system which supports 
20 Fabric poim-to-point topology on each link. 

?rit?f T^fixriptio" "f Hrawines 

no. I is a diagram illustrating the use of a Fibre ChamKl Fabric. 
FIG. 2 is a block diagram of a Fibre Channel Fabric, 
no. 3 is a bk)ck diagram of the Fabric Control module. 
25 FIG. 4 is a block diagram of the fabric Router. 

HO. 5 is a block diagram of the fabric Port Control. 

RG. 6 is a block diagram of the fabric Switch core 

HG. 7 is a block diagram of the Brouter Module. 

FIG. 8 is a diagram of the Port Control HFO Overrun Prevention Logic. 
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FIG. 9 is a diagram of the Port Control Process to Endec Arbitration Logic. 
FIG. 10 is a more Jetailcd description of the Port Control module. 
FIG. 1 1 is a diagram of the main Port Control FSM. 
FIG. 12 is a diagram of the Port Control PCFIFO module interface signals. 
FIG 13 is a diawam of the Router address matching module. 
FIG. 14 is a diagram of .he Router Route Request Unblock Deteitnination 

nwxlule. 

FIG. 15 is a detailed diagram of the Route Request Unblock Determ.nat.on 
module circuit. 

HG. 16 is another detailed diagram of the Route Request Unblock 

Determination module circuit. 

HG. 17 is a diagram of the Blocked Route Request Table. 
FIG. IS is a diagram of the Router Control State Machine. 
FIG 19 is a diagram of the Blocked Route Request Port Register Array. 
FIG. 20 is a diagram of both .he Route Sn..c Table and the Route 

Determination modules. 

FIG n is a more detailed diagram of the Route Determination module. 

FIG. 22 .s a anod«r more detailed diagram of the Route Determination 

no. 23 is a still another more detailed diagram of the Route Determmauon 
module. 

HG n is a diagram of the Port Control Route Request Interface module. 
HG ^5 is a diagram of the Port Control Route Response Interface module. 
FIG. 26 is a diagram of the Router to Pon Control Route Request State 
25 Machine. 

FIG. 27 is a diagram of the Router to Port Control Route Response State 
Machine. 

FIG. 28 is a diagram of the Port Control to Router Interface State Mach.r«. 
HG 29.is a diagram of the Hub Port Control module. 
30 FIG. 30 is a diagram of the forma, of the Blocked Route Request Table entry. 

HG. 3r.s a diagram of the format of the Route Request. 
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FIG. 32 is a diagram of the formal of the Router to Port Contiol Response. 
FIG. 33 is a diagram of the format of the Address Table entry. 
FIG. 34 IS a diagram of the format of the Route Sute Table entry. 
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A. Definitions 

B. Fibre Channel Fabric Model 

C. Fabric Control Module 
10 D. Fabric Router 

I Port Control Route Request Interface Module 

2. Port Control Route Response Interface Module 

3. Address Table 

4. Address Match Module 

5 . Blocked Route Request Table 

6. Blocked Route Request Port Register Array 

7. Blocked Route Request Tuner 

8. Route Request Unblock Determination Module 

9 . Route Request Selector 

10. Route Determination Module 
U. Route State Table 

12. Router Statistics Gathering Module 

13. Router Control FSM 
E. Port Control 

23 I. Port Control Module 

2. FIFO Overrun Prevention Logic 
3 Processor/Data Arbitration Logic 
4. Port Control Hub Module 
F. Switch Core 
30 G. Router Module 
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H. Other Documents 



A. Dfifiniiiiins 

For expository convenience, the present mvention is referred to as the F.bre 
Channel Fabric or Fabric, the l.x.con being devoid of a succinct descriptive t«tne for 
a sv«!tem of the type hereinafter described. 

The -Fibre Channel ANSI sundard" describes the physical interface, 
.ansmission protocol and signaling protocol of a high-pcrfomtance serial Hnk tor . 
support of the higher level protocols .sociated with HIPPI.IH. SCSI. IP.A^ 

The -Fibre Channel Fabric" comprises hardware and software that switches 
Fibre Channel frames between atu^hed devices at speeds up to or. gigabu per 

.second. . ^ _ 

The following discussions will be made dearer by a br.ef rev.ew of the 

relevant terminology as it is typically (but not exclusively) used. 

-Fibre Channel- 'is an American National Standard for Information Systems 
.ANSI, standat. which defines a high performance serial Un. for support of the 

A -.v. HiPPt tPl SCSI IP, ATM. FDDl and others, 
hieher level protocols associated w,ihHIPPl.IPI.5>^fi i''- 

■ .'FC-r defines the Fibre Channel transmiss.on protocol which includes the 
serial encoding, decoding, and error control. 

-FC-2- defines Oie signaling protocol which includes the frame structure and 

bvte sequences. ^ - 

' ^FC-3- defines a set of services which are common across multiple ports of 

' -FC4- is the hitjhest level m the Fibre Channel standards set. It defines the 

,5 t^ppin. between the lower levels of the Fibre Chatu.. and the IPI and SCSI 
col^sets.theHIPPIdatafram.g.IP.a«.otl.rUpperUvelP.tocols(.LP.^ 

-Fibre" is a general term used to cover all tnnsmlssion media specified .n d,e 
ANSI X3 230 'Fibre Channel Physical and Signaling Interface (FC-PH)" standard. 
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A -fabric- is an cnticv which imerconneccs various N.Pons attached .0 U and 
K capable of rou.ing frames by using only the D JD information in the FC-2 frame 
header The word Fabric can be seen as a synonym wid. .he word switch or router. 
-Fabric topology- is a topology that uses the Destination Identifier (D.ID) 
5 embedded in the Frame Header .0 route the frame through a Fabric to the des-red 

destination N_Port. ..u^ 
-Poim-to-point topology- allows communication between N.Ports without the 

use of a Fabric. 

A -Circuit- is a bidirectional path that allows communication between two 

10 L Ports. . 

" -Arbitrated Loop topology" permits three or more L.Ports to using arbttratton 
to establish a point-to-point circuit. When two L.Ports are communicating, the 
arbitrated loop topology supports simultaneous, symmetrical bidirectiot^l flow. 

-Link control Facility" is a fac.lity which attaches to an end of a hnk and 
,5 manages transmission and reception of data. U is contained within each Port tyi«. 
-Port- is a generic reference to an N.Pon or F.Port. 
An -N Port- is a hardware entity which includes a Link Control Facility. 
An -NL.Port-'is an N.Port dta. contains Arbitrated U>op functions associated wtth 

Arbitrated Loop topology. 

An -F Port' is a generic reference to an F_Port or FL_Port. 
An -FL.Port- is an F.Port that contains Arbitrated U>op functions associated 

with Arbitrated Loop topology. 

An -L.Port- is an N.Pon or F.Por. that contains Arbitrated U»p functions 

associated with Arbitrated Loop topology. 

A -Node- is a collection of one or more N.Ports controlled by a level above 

A -dedicated connection" is a communicating circuit guaranteed and retained 

by the Fabric for two given N_Ports. 

A -connection- is the process of creating a Dedicated Connection between two 

30 N Ports. 
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' AMisconr«ction-istheprocessotr.movm^^ ' 
two N_Ports. 

A "frame" is an indivisible unit of information used by FC-2. 
"Frame content" is the information contained in a frame between its Start-ot- 
Frame and End-of-Frame delimiters, excluding the delimiters. 

A -data frame" is a frame containing .nformation meant for FC-4/ULPor the 
Link application. 

• Payload- is the contents of the Data Field of a frame, excluding Optional 

Headers and fill bytes, if present. 

-Source Weminer" or SJD is the address identifier used to indicate the sou.ce 

Port of the transmitted frame. 

-DestiiBtion Identifier" or D.ID is the address identifier used to indicate the 

targeted destination of the transmitted frame. 

-Valid frame" is a frame received with a valid Star, of Frame (SOF). a valid 
End of Frame .EOF), valid Data Characters, and proper Cyclic Redundancy Check 
(CRO of the Frame Header and Data Field. 

-Classes of Service" are different types of services provided by the Fabric and 
used bv the communicating N Ports. 

"-Class r service is a service which establishes a dedicated connectton 

•»0 between communicating N Ports. 

-Class 2- service is a service which multiplexes fiames at frame boundaries 
,o or from one or more N.Ports with acknowledgemem provided. 

-Class 3" service is a service which multiplexes frames at frame boundaries 
a, or from one or more N_Pons without acknowledgemem. 
25 -intermix" is a service which interleaves Class 2 and Qass 3 frames on an 

established Class 1 connection. 

A "Gieabit Link Module" ts a module which interfaces to the Endec through 
cither a lO-bii or 20-bi. interface and interfaces to the Fibre Channel link through 

either a copper or fiber interface. 
30 An -Encoder/Decoder" or Endec.sadevicewhichimplementstheFC-1 layer 

protocol. 
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A ' Router • is a module which detemines the desiination port from an address 
and other Fibre Channel traine parameters. 

A -Port Control- is a module which reads in a Fibre Chatuiel header, requests 
a rout<5 and forwards the frame to the switch core. 

-Credit- is the login credit which represents the number of frames that may 
be transmiued before receiving an acknowledgement or R_RDY. 

• Fabric Login Protocol" is when an N.Port interchanges Service Parameters 
with the Fabric by explicitly performing Fabric Login protocol or implicitly 
through an equivalem method not defined in FC-PH. 

"Application Specific Integrated Circuit" or (ASIC), an integrated circuit 
designed to perform a particular function by defining the intercom^ection of a set of 
basic circuit building blocks drawn from a library provided by the circuit 
manufacmrer. 

-FPGA- Field Programmable Gate Array, a gate array where the logic 
network can be programmed into the device after iu manufacture. An FPOA consists 
of an array ot logic elements, either gates or lookup table RAMs. flip-flops and 
programmable interconnect wiring. Most FPGAs are dynamicaUy reprogrammable, 
since their logic tunctions and intcrcomKCt are defined by RAM cells. 

"FIFO" a data structure or hardware buffer from which items arc taken out 

-JO in the same order they were put in. 

"Brklge" a device which forwards traffic between network segments based on 
dataiink layer informaiion. These segments would have a common network layer 
address. 

"Router" a device which forwards traffic between networks. The forwarding 
decision is based on network layer information and routing tables, often constructed 



IS 



25 



by routine protocols. 

-Brouter- a device which bridges some packets (i.e. forwards based on 
daulink layer information) and routes other packets (i.e. forwards based on network 
layer information). The bridge/route decision is based on configuration information. 
30 "Hub" a device connecting several other devices. 
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"Serdes- serial encoder/decoder, converts the Fibre Channel serial interface 
to/troin a 10 or 20 bit parallel interface. 

-HIPPI" is a computer bus for use over fairly short distances at speeds of 800 
;,nd 1600 megabytes per second. HIPPI is described by the ANSI standard X5T9/88- 
127. 

-SCSI" or Small Computer System Interface is a standard for sysiem-leve. 
interfacing between a computer and intelligent devices including hard disks, tape 
drives, and many more. SCSI is described by the ANSI standard X3,13M986 and 
bv ISO/IEC 9316. 

-ATM- or Asynchronous Transfer Mode is a method for the dynamic 
allocation of bandwidth using a fixed-size packet, also called a cell. 

-SNMP' or Simple Network Management Protocol is an Internet Standard 
protocol denned in RFC 1157. developed to manage nodes on an IP network. 

-MIB" or managcmem information base is a database of managed objects 
15 accessed by network management protocols such as SNMP. 

-Web- is the World-Wide Web. an Internet client-server distributed 
.nfomvation retrieval system which originated from the CERN High-Energy Physics 
Laboratories in Geneva. Switzerland. 

•Web Browser-- is a program which allows a penon to read information from 
,he Web, The browser gives some means of viewing the contents of nodes (or 
-pages") and of navigating from one node to another. 
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B ^h«""e' P"*^"^ Model 

Referring to Fiu. 1. a Fibre ChamusI Fabric is an entity which transports Fibre 
Channel frames between attached devices. The data transmission between the 
connected device port (i.e.. N.Fort, and the Fabric port (i.e.. F.Port) is serial and 
consists of one or more frames. The transmission protocol and speeds along with the 
fabric functionality are defin^l in the American National Standard for Information 
Systems (ANSI) FCPH standard (see Other documents, section H. below). 

The pnmary function of the Fabric is to receive frames from a source N_Port 
and route the frames to the destination N_Pon whose address identifter is specified 
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„, ,he trames. Each N.Pori is physically attached through a link to the Fabric or in 
,he case of an Arbitrated Uk>p topology attached to the same loop. FC-2 specifies .he 
protocol between the Fabric and the attached N_Por.s. A Fabric is characterized by 
a sinale aUdress space in which every N_Pon has a unique N_Pon identifier. 

' The Fabric model coniainstniee or more F.Ports or FL.Poru. Each F_Port 
is attached to an N Port through a link. Each F.Port is bidirectional and supports 
one or more communication models. The receiving F.Port responds to the sending 
N Port according to U« FC-2 protocol The Fabric optionally verifies the validity of 
.h^ frame as it passes through the Fabric. The Fabric routes the frame to the F_Por. 
directly atuched to the destination N.Port based on the N.Port identifier (DJD) 
embedded in the frame. The address translation and the routing mechanisms withtn 
ihe Fabric are transparent to N_Port5. 

There are two Sub-Fabric models, a Connection based model and a 
Connectionless based model. The Connection based Sub-Fabric provides Dedicated 
Connections between F.Ports and the N_Ports attached .o these F.Ports. A 
Dedicated Connection is retained until a removal request is received from one of the 
commumcatin« N Ports or an exception condition occurs which causes the Fabric to 
remove the Connection. Tl« Connection based Sub-Fabric is not involved m flow 
.cntrol which is managed end-to-end by the N.Ports. If the Fabric is unable to 
aablish a Dedicated Connection, it remms a busy or reject frame with a reason code. 

A Connectionless Sub-Fabric is characterized by the absence of Dedtcated 
Connections. The Connectionless Sub-Fabric multiplexes frames at frame boundaries 
iKtween an F Port and any other F.Port a«l between the N.Ports attached to them. 

, uive'n frame flows through the Connectionless Sub-Fabric for the duration 
of the rotitin.. Afler the frame is routed, the Connectionless Sub-Fabric is not 
required to have memory of source . touting or destination of the frame. When frames 
from multiple N Ports are targeted for the same destination N.Port m Class 2 or 
Class 3. congestion of frames may occur within the Fabric. Management of this 
coneestion is pan of the Connectionless Sub-Fabric and buffer-to-buffer flow control. 

FIG. 1 shows a possible environment containing a Fibre Chamtel fabrK. The 
fabric I. 2 illustrated are connected with a mix of workstations 3. disk arrays 4. 
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mainframe computers 5. and Persona, Computers (PC) 6. Fabrn: imerconnecuon .s 
no. limited to particular equipment or a network topology as illustrated tn HG. I. 
Two types ot fabric topologies are illustrated .n FIG. I., the direct fabric attached 
topolooy 9 and the arbitrated loop topology 7. 
5 "the fabncs in FIG. I arc shown interconnected or networked through a link 

3 links .0 .he fabric can operate a, either 266 Mbps. 533Mbps or 1.063 Gbps 
speeds and operate over euher copper or fiber n«dia. or any other compatible medta.. 

FIG. 2 .shows a block diagram of the fabric. The fabric is composed of a 
fabric control module 54. a router module 52. multiple port control modules 51. 74. 
,0 75 a switch core module 53 and optionally one or more brouter modules 55. As .s 
understood in the art. the functions allocated to these respective devices may. m 
alternate emboditncnts. be allocated to different logical blocks. 

The fabric control module 54 coouins a processor and associated hardware. 
The fabric control module software performs but is not linuted to the following 
15 hanctions: (1) Fabric power on self test. (2) Fabric configuration. (3) Broadcast. 
S^ple Name. ARP and Directory services servers, ,4)Fabric LOOP Attached pcofi. 

Extended link service command. (5) Management. (6) Network Management SNMP 
..gent (7) web based fabnc management. (8) Uninterruptable power supply 
monitoring and control, and (9) Brouter Module Conf.guraUon/Control. ^ Fabnc 
20 control module controls and configures the rest of the fabric but is not usually 
involved in the normal routing of frames. 

The fabric Router 52 performs some or all of the fbUowing functions: (I) route 
address matching. (2>routedetermina.ionbasedontheANSlX3Tli rules. (3, route 
request blocking and unblocking. (4) switch core programming 63. (5) stattsttcs 
25 collection and (6) port control module route .quest/response handling 59. 60. 61, 62. 

The Lc Port Control modules (PCM) 51 . 70. 74. 75 perform some or all 
of the following functions: ( 1) «ceive Fibre Channel frames from the ftber or copper 
n«dia 56. 77. 78. (2) perform frame validation. (3) send a route request to the router 
30 59 61. 66. 72. (4) receives a route response from the router 60. 62. 63. 67. 73. (4) 

^r^rp^ ^1 M and (5) either discards the frame, 
forwards the frame to the switch core 57. ana v^; 
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modifies the frame imo a tabnc reject .F_RJT. or fabric busy (F.BSY) frame or 
forwards the frame depending on the route response from the router. 

The fabric switch core 53 is a nonblocking NxN matrix switch with 36 bit 
wide transmit and receive l/Os. The switch core switches frames from the PCMs 51. 
70 74. 75 to the destination PCMs or Brouter Module. 

The Brouter Module 55 nerfon,s some or all of the following functions: 
protocol brideing and/or routing function between a Fibre Channel network and the 
network implemented by the Brouter Module. The Brouter Module "looks- hke a 
Fibre Channel port to the rest of the switch. This is due to a protocol conversion 
timction in the Brouter Module which converts the brouter networked frames to F.bre 
Channel frames. Converted Fibre Channel frames from the Brouter Module enter the 
fabric switch through an internal port control module 70. Fibre Channel frames from 
the fabric switch core enter the Brouter Module through an internal path 76. 

C pphrjf rnntml Module 

FIG 2 shows the Fabric Control module (FCM) 54. The FCM 54 serves 
some or all of .he following funtions: configures the fabric, collects and reports 
network management parameters and implements the fabric denned servers such as 
.heSuTtple Name server. Directory Services, etc. The FCM 54 configures the router 
50 the port control modules 51. 74. 75 and the brouter module 55. 

FIG 3 shows the Fabric Control module (FCM) in more detail. The FCM is 
nude up preferably of fast SRAM 82. DRAM 83. a DUART 84. flash memory 85 
.nonvolatile storage), a processor 81 and a Decode/DMA Control module 87. The 
code for the processor is contained in the flash memory 85 and is copied to SRAM 
upon bootup. The interface to the brouter module 55 allows the FCM to 
communicate through legacy networks such as ethernet and fast ethemet. dependmg 

on the brouter module. 

The FCM is attached to the rest of the fabric in two different manners: both 
in-band 80 to the fabric and out of band 79 .0 the fabrtc. The in-band conrtection is 
through the internal pon control module. This connection allows the Fabric Control 
Module to communicate with both locally and remotely atuched Fibre Charaiel 
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cumplianc devices via Fibre Channel frames. The FCM connects out of band to the 
rest of the system for monitoring, initialization and control reasons. 

D. F '^"•■^ '^""t^'" 

The Fabric Router 52 (FIG. 2) receives route requests generated from the Port 

S Control modules 59, 61. 66. 72. determines the frame route, reports the route 
responses to the Port Control modules 60. 62. 67, 73. programs the switch core to 
connect and disconnect the routes 63. manages blocked route requests and collects the 
routing statistics. In the preferred embodiment, d«re is o>« central router contained 
in a fabric. The Router 52 connects and discomiects routes on a frantc by frame 

,0 basis. Since the router can determine a route in real time (i.e.. Fibre Cham«l frame 
,in,e> the Fabric can support Class 1 frames. The router is realized in hardware 
through either an FPGA or a custom ASIC. The router is composed of thtrteen 
fiinctional modules as illustrated in FIG. 4: 

(1) Port Control Route Request Interface (PCRRIM) 130 

(2) Port Control Route Response Interface (PCRSPM) 144 

(3) Address Table 132 
<4) Address Match Module (ADM) 13 1 
(5) Blocked Route Request Table Module (BRTBL) 133 
(6^ Blocked Route Request Port Register Array (BRRA) 134 

(7) Blocked Route Request Timer (BRTMR) 135 

(8) Route Request Unblock Determination Module (RRUNB) 136 

(9) Route Request Selector (RRS) 137 

(10) Route Determination Module (RDM) 138 

(11) Route State Table (RST) 139 
Router Statistics Gathering Module (RST) 141 



(12> 



1. 



(13) Router Control FSM (RCFSM) 140. 
P^rT rnmrni Rou t n R 'ni n' '""'^'"^'^ Modiile (PCRRIM) 



The Pon Comrol Route Request Interface Module (PCRRIM) 130 of FIG. 4 
(and RG. 24 numeral 581) interfaces with the PCMs (51. 74. 75 of FIG. 2) to read 
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route requests at^U registers the route request for use by the imernal router nwdules. 
The PCRRIM FJG. 24 is ui.mposed of the following tiinctional blocks: round-robin 
;,rb.irt>tion 582. route request state machine 583. registered route request 584. and the 
port winning arbitration register 585. The PCRRIM 581 is connected to each PCM 
(items 56. 77 and 78 of FIG. 4) through a separate PCM requester signal 586. The 
PCRRIM 58 1 is also connected to each PCM through a common shared route request 
data channel 588. After a PCM captures an incomLng frame and builds a route 
request the PCM raises the PCM route request signal 586. The PCRRIM round robin 
arbitration block 582 will read all request signals and choose the requester in a round 
robin manner. This implements requester fairness, i.e.. one requester will not be able 
to starve other concurrent PCM ix:questers. The round robin arbitration block 582 
will notify the winning PCM requester via the route request state machine 583 by 
pulsinu for one dock period the PCM acknowledge signal 587 back to the winning 
PCM . Durin- the next four clocks die PCM serxis the route request over the common 
route request channel 588 to the registered route request block 584. The Route 
Request channel is implemented as an eight bit bus. but is not restricted to that size. 
The route request is thiny two bus and is shown in FIG. 31. The signals are 
described below. 

BciU£.Bfiauesi Desciiciifiii 

SID Mk^tch lnd.ca.es that the incoming frame SID does not match 
(he expected SID 

EOFrcvd ln«»icates that the entire frame including the EOF was 

received . 

Route Direct A tlae to override the router address matching logic 
Route Direct ^^^^ ^^^^ ^. ^^^^ ^ ^^^^ ^^^^^ 

module out to a specific port without the use of the DID 

field . 
Delimiter Is an encoded field which specifies the received frames 

delimiter ... 
Destination The DID from the incoming frame. This field is valid 

4,idre« onlv when the route direct flag is not set. 

■^sUnation port Oniy valid when the route direct Hag is set. indicates 
to route to the remote pon to route the frame to. 
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The winning PCM port number is registered 585 (FIG. 24) and held for use 
by the internal router modules 589. The PCRRIM is controlled by the Router Control 
FSM through the request serviced signal 591. The PCRRIM will raise the request 
valid signal 590 whenever it has a valid route request from a PCM in its register 584. 
The PCRRIM will halt any further route request reads from the PCM until the request 
serviced signal 591 is pulsed for one clock period by the Router Control FSM. 

FIG. 26 shows the PCRRIM state machine. The state machine is described 

below. 



20 



IDLE6U 

CMP RR VECT612 



SHIRT^RR.VECT 613 
WAITCLK 614 



LDWORDO. 1,2,3 
615.616.617.618 



RTNAVAIL619 



np<;cription 
Wait for a route request from a port control 
Route robin logic, compare the cunenl select 
vector with the port control. If a match 
tv:curs the port control is currently requesting 
a route. 

Shift the current select vector . 
Signal the select port control module, watt 
one clock before reading the route request 
channel for the route request. 
Read the route request from the route request 
channel. Since the route request channel is 8 
bits wide and the route request is thirty two- 
bits, four clocks are needed to read the route 
request. 

Wait until the Main Route Control FSM 
signals that the route request is no longer 
needed (RTACK) then remrn to idle and wait 
for another route request from the port 
control modules. 

2. p.., r^ prroi Rnut. -^r^non^r Inirrfficc Mm l iilr (PCRSPM) 
As shown in FIG. 4 the Port Control Route Response Interface Module 
(PCRSPM) 144 interfaces with all the PCMs 114. the Route Determination module 
ns and the Router Control FSM module 140. The PCRSPM main Won is to 
.eturn route responses to the PCMS 114. The PCRSPM 144 is independent of the 
PCRRIM 101 which enables the router 52 to concurrently receive route requests and 
send route responses. This separation in ftmction adds parallelism to the router, 
permits pipelined operation of the router and increases its performance. 
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M *,.n ,n HO, :5 .h< PCRSPM » P^tablv cmnpos«l ot .he r.«».i.S 
bloc.,: a« ^pons. su« 602 .nd U. »s^- 

L,™ ,h. PCM ™.sp»..i« .« pen 60, b, -be PCM «P««e 

,1^1 «« "« »• """"'2 

™, b« wide Channel ""^ "« "P"'"'""' 

HO. r ra«PM«n»c«.,l»n, 602 0. FIG. 25,. Tbe « 

machine is described below. 



15 IDLE 631 



Qffirription 

^ Waic for main Router Control FSM to assert the 

return route response signal. ,ncM,h,fthe 
v.4tp<:p Acknowledge the main Router Control FSM that the 
XMTRSP 63. AcUo ^.^^ ^ ^^^^^ ^^^^ , 

port control module the route response w.ll be on he 
oute response data channel on the next two clocks ^ 
XMT DTO 633 Uad the first eight bits of the route response on the 

XMT.DTI 634 L ^^^^ IDLE. 
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3 i\Myf'^'^ Table 

The Add,., T.b,e 1)2 .( FIO. 4 is 1*1* "J *« 

,^,,„„eco™,o,™.d... ,22. •n.Add^T«e,22c»»,»««i«.S.b-,«« 
,,.,„co«f,b,eCte™e,l-a«««-n«»«*-'W'''«^-™^ 

i„„,y b« »*l»s .1». .id. . «■ «^ 

,„e D ID i. *Nr«, -a, *e »s» "si- ""l « « 

compared ,0 ,b.'.dd„» -egU.r. ThU pertonned 0. », 
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. u Mr^^c This also implements routing based on any • 
number of bits m the address. This aiso lui^ 

^ *H f>n r»« ,« -ran. » ^ ^ 

^ - * " T 

The AiMctss MMch moJule 13 (ADM) " ' 

--'"'"■r,Tr.rr.3i::r:3.^»a....... 

Address MaBlii"*^!"" " 
1 „s„,. ^ Pn* d=c.d ^d o. .ddi^s pno., co».^ 

iirbrco™™. — .,«p, oiisi""". *= <^7 

u, the Fabnt con mcoming frames which 

5 module. This allows *c fabric control module to process 

is useful >vhen dK fabric is h.nc«oning in certain er»vironmems. 

«H.d W"*'^ ^ ■""^ ^ " 
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PCM pon. bloc. ,.3»», .^r .» EOF - 

PCM. .c. .h. e»l« f»« ««>.e. t.f.,. 

,F sjTi or 6b.i= b»>y if.esi" " 

R<«, C^uro, FSM. B^W « ^ " CU^™ ^ 
. ^ ... Rou,=, Co»., FSM. pen .np.. " 

1 bid rou.. « .0, «ch PCM a:^ a« b,«« ^ «^ « 

one niociLc i ^^^^^^ ^^q^^^, 

Unblock Dcie-minaaon modute FK). 4 W. « *o"» 

indicaieUbylheSOFOelimiler. 

n mlrn Pnr- ^™ ''"^ , , 

T« Btocked Rou» Rcu.,. Pon R=*«r Amy >» ^B"^, ,n FK3. 4 ,^ 

,„ o-e »,«sn«. po. 10= - ■"<> ' ™ „ 

«o.e,,.«u.....o».M^u.^^^^^^^^ 

module 136. The BRRA is shown in more detail m FIG. 19. 
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483 signal from .he Rouier Control FSM is pulsed for one clock period the requesting 
PCM port 482 is saved into position 0 numeral 489 of the register array. Register 
array entries are removed by the Route Request Unblock Deiennination module 
through the CLRFIFO 488 signal and DEQRQ.SEL 485 vector, i.e.. when the 
5 CLRFIFO signal is pulsed for one clock period the BRRA will unload the register 
specified by the DEQRQ.SEL vector. 

Position 0 numeral 489 contains the newest route request and position 16 
numeral 490 contains the oldest route request. Register array contems are shifted by 
one from the newest position to the oldest, when the LOADRFO signal is pulsed to 
10 make room for the newest blocked route request port number. The shifting circuit 
must take into account 'holes' in the register array. The algorithm identifies the Ftrst 
free register array entry closest to position 0 and shifts all the entries from position 
0 to the' free register array entry. The shifting circuit creates a shift vector (STTMP) 
which is used to load the contents of the individual register array entries. The circutt 
15 is shown below in verilog for eight ports. 

alwavs@(Fl NULLorF2 NULL or F3_NULL or F4_NULL or F5_NULL 
or F6_NULL or F7_NULL or F8_NULL) begm 

// build fifo shift control word (indicates how to shift fifo) 
casex («F8 NULL. F7 NULL. F6_NULL. F5_NULL, 
20 casex ^^^^-^^^^-^^ -^y^L. F2_NULL. Fl.NULL}) 

8'bUxxxxxx: STTMP = S bllUUn; 

S bOlxxxxxx: STTMP = 8'bOUl UU: 

8'bOOlxx.xxx: STTMP = 8'bOOllllll; 
75 8'bOOOlxxxx: STTMP = 8'b00011lll; 

8'bOOOOlxxx: STTMP = S bOOOOl 111; 

8'bOOOOOlxx: STTMP = 8'bOOOOOlll; 

8'bOOOOOOlx: STTMP = 8'bOOOOOOll; 

8'bOOOOOOOl: STTMP = 8'bOOOOOOOl: 
30 default: STTMP = 8'bOOOOOOOO: 

endcase 
end // always 

where F1_NULL F8_NULL are true if register array position I to 8 

(respectively) are empty. 

35 
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Tte shitting vector is .hen used with the CLRFIFO signal 484 and the dequeue 
pon signal iDEQRQ.SEL) 485 to clear the register array contents, 
always Otposedse elk or negedge reset) begin 
ifCres^O FIF02 < = NUaVALUE; 
5 else if (LQAliEIBL&iLSIIMElll) 

FIF02 <= FIFOl: 
else if (CLRFIFO && DEQRQ.SEL = = FIF02) 

F1F02 < = NULLVALUB; 
else F1F02 < = FIF02; 

10 end 

7. rIitItH P""^" ^ ■"'"^ (BRTMBi 

The Blocked Route Request T.mer 135 (BRTMR) in HG. 4 implements one 
timer per PCM. The timer is enabled when a route request is blocked for the 
particular PCM. The timer i.s disabled when the blocked route request becomes 
unblocked. The BRTMR is controlled by the Route Control FSM which not only 
enables the timer but also mdicates which timer to enable. Enabled timers are 
selected bv the port from the incoming route request 104. Disabled tuners are 
selected by the port from the route request selector module 146. The different timers 
.re defined bv the ANSI FCPH standard. When a timeout occurs the Route Request 
Unblock Determination module is signaled 119 to dequeue the blocked request as 
soon as possible. 

The Route Request Unblock Determination module 136 (RRUNB) in FIG. 4 
determines when and which blocked route request to unblock. The RRUNB reads 

Port Ret^tster Array 118 the Blocked Route Request Timer 119 and the Route State 
Table 124. A more detailed view of the RRUNB is shown in FIG. 14. BG. 15 and 

no. 16. , . , 

AS shown in FIG. 14 the RRUNB 361 reads information from several mtemal 
router modules and determ.nes the most recent and highest priority blocked route 
request to dequeue from Ute Blocked Route Request Table. The RRUNB signals the 
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™ Th. inputs ,. U» WtUNB teWc * Mlowing Womauon fn>n, .be R<« 
^„ Tab,.: !>«. » busy «™al 365 - .1.= Po„ is »™.* " ' J'"' 

::lsi,»i».Tb..,u,s,«,be«.UNB.u,,b.B,«^.»-^^ 

T* iuciud. a« b«K«. '" 

,« b.»™ ,«= b.b - .isco™^^ ' °- ' - " 

Ki/v-vpd route request is a Class I frame. 

™ bow.p.-.o.-.RKUNB.^wb^^'"-"'"'"™ 

A-'S 424. to generate the remote status 430. 432. 434. 

15 to select the remote port busy s.gt»al. U is also 
,..,rr,.ntiv in a Class I contKCtion signal" 

curret^tly m ^^^^^^ 

20 following circuit: 

DEQO FLAG = Timeout indication for port 0 from RTMR 1 1 

(remote port 0 Class I connected)))) 
TlKt«.«outindicationis|eneratedfromtheBRTMR.ncKiule362ianai4^ 

25 I IK iinico connected signals 434 are 

The remote port 0 busy 430 and the remote port 0 Class I connec 

inercmu (~ . cir ifi The block reason comes from the 

generated from the circuit described m HG. 16. The bloc 
BRTBL369 There is one DEQOJLAG signal for every PCM. 

As.how„.nFIG.15cachDEQaAG38U382sig«..is.putmtos«te^^^ 

. . m 384 representing the number of potentially blocked route requests. 
30 multiplexers 383. 384. represen g ^^.^^ 
Multiplexer numeral 383 uses the pon number m the BRRA register 
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U, 16 —1 3«6. f o, e«ple it U« c»,»K o< 0 » .« BR8A 

------ 

signal. DEQ16IND being higher il.an DEQOIND and -ncoaes 

n ,h, RRRA 39-» 393 to dequeue 394. For example 
W which selects the position in the BRRA 39-. .... ....rrra 

;r- DEQ16IND signal is set then the pen n.m.her contained in pos...on 16 of the BRRA 
K output 394 from multiplexor 391. 

P,0 ,5 auo d.«,»», . w« — 

:L.y— O«--T.™,..^0.-3--~ 

The iwMs » imWpl"" »""«"' "1"^ 

1 riass I frame 408. Multiplexor 

i»pr^.»-C.ss , ,^p«.40,....cnoo..n„b.o,*s,» . 

" «.U b. ^ .« »b,o. .ype. . «s..», b.,.. .b„ 

Uie blocked route request within one clock. 
9 Prini; Rirnu*''^' Selerror (RRS) 
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The Route Request Selector module 137 ,RRS) in FIG. 4 ft^nctions to select . 
between the inconiing route request from the PCRRIM module 108 or the BRTBL 
,15. The resulting route request is output 1 10 to .he Route Determination module. 
The RRS is controlled by the Route Control FSM 140. 

5 10 p»,.'ff r>W'"'inii^'n M^^^"'*' ^^^^^ 

The Rome Determination module 138 (RDM) in HG. 4 applies rules defined 
in the ANSI Fibre Chamtel specifications to calculate how to route the incoming 
rrame The RDM receives the route request 110 from the RRS 137 along with route 
context for the source and destination ports 112 from *e Route State Table 139. The 

,0 RRS outputs the route results 145. Ill to both the Router Control FSM I40andthe 
PCRSPM 144. The RDM is implemented m combinatorial logic and applied the route 
rules in one clock. 

FIG ^0 shows the RDM 501 in more detail. The RDM reads the route 
request from the RRS which includes the source requesting port 503. the destination 
,5 p.>rt 504. the frame SOF delimiter 505. the EOF received flag 506. the route to port 
Oae fabric controller) .lag 507 and the timeout indication 508. The RDM also 
,«ads in the route table context tor both the source and destination ports 5 12 and reads 
i„ a test enable vector 513. The test enable vector 513 turns off selected route rule 
checlcs tor more ne..bility when the router is implemented m an ASIC. The outputs 
from the RDM include the route results vector 509. 510 which indicates whether to 
route the frame or return an error, the reject/busy action/reason vector 10 which ts 
valid when the RDM detects an error and the route baclc indication 51 1 which signals 
,he port that the frame is in error and will routed back to the same pon. Finally the 
updated source and destination port contexts are updated to reflect the RDM actions 
■>5 5 14 and wired back to the route state table 502. 

FIG ->! shows the RDM route selection logic in more detail. As memtoned 
earlier the inputs to the RDM include the route state context for both U« source and 
destination ports 522 a«i the route request 523. The RDM has prewired rules checks 
Octec. nve conditions: discard frame 515. block the route request until the remote 
30 port ts not busy 526. return a fabric reject (F_RJT) frame 527. return a fabrtc busy 
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(F BSY) frame 528. wail um.1 the frame is completely received 529. Ifallof the four 
conditions are .K-t detected then the frame should be routed successfully to the remote 
port The conditions mentioned above are derived from the ORing of multiple rules 
checks. For example the discard frame signal is derived from the ORing of five 
S discard frame mles checks, .^n example rules check is shown below. 

// discard frame if local SOFcl received and local port is in a class 1 
rDlsFRM4 = TENCl DELIM = = SOFnl && SRC_CSTATE == 
Connected: 

,0 TheTEN(21termaboveselectsabitfromthctestenablevcctor. Tumingthe 

bit off will disable d,e above rules check. The rule above will assert the DISFRM4 
signal if the incoming frame contains an SOFnl delimiter and the mcoming port « not 
alreadv in a Class 1 conneciion. 

' AS showtJ in FIG. 21 all potential rules check results 531 are encoded and 
15 elected by using the rules checks 525. 526. 527. 528. 529 as the multiplexor 
selector. The routing result selected is then output 532 to both the Router Control 
FSM and the PCRSPM. Ml rules checks are completed within one clock per.od. 

Finally HG. 22 shows how the preencoded fabric reject 544 and fabric busy 
^sponses 548 are selected by the fabric reject 542 and fabric busy 546 rules checks. 
,0 The result 551 is output to the PCRSPM module to be included in d« route response. 
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U Pmir? ^r?^** Ti^^'^ ^RST) 

RC 4sl».s,teRo».S»«T*le(RST)l39. Tt. of .K RST » 

,„ «ep ,h= co„.« fo, each p.-,. Tl« RST inK,tes «* Ite R« 

10 unblocking calculation. 

Tl. RST C<«1» . com... ^r«, .« p<«. m co« » 

below lists the context fields. 

DestinatSort If a route axis, chis specifies the remote port. 

S'^rOeLtion If t.is port is in a Class 1 connection this fieid 

„ specifies the remote port. 

Su.e !?^his port is wait.ng for a route and a timer ts 

25 T.mer State enabled, this field specifies the timer. 

Class I Connection This field specifies whether this port .s currently 

c T in a Class I connection. 

Pnn Busv This field specifies whether this port ,s currenUy 

Port Busy routing a frame to a remote port. 

Pnrt Siaie This field specifies the link state, whether 

^'''^ initializine, offline, online, or error. 

Class supported This field specifies the Classes of serv.ce 
30 Liassauppu supported by this pon. . 

LOOP port Indication iL field specif^s whe^er th.s port .s a loop 
LOOP ru ^ ^ p^,„j 
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Pon Specil This field specifies the link speed tor this port. 

Intermix Support This flag specifies support for Intermix for this 
port. 

FLOGl <KCured This field specifics whether a aOGI/ACC 
exchange occurred. 

12. p ■.^i ffr SMtisti c -t r,fithmiH> Module (RSG> 
5 no 4. shows the Router Statistics Gathering Module (RSG) 141 . The RSG 

o.aihers fabric generated statistics. The RSG is enabled by the Router Control FSM 
140 and has as inputs the source and destination ports, the route result and the frame 
Class 142. The RSG is implemented in hardware because of the requirement of 
collecting statistics at gigabit rates. 

,0 13. m^r (RCFSM) 

FIG. 4 shows the Router Control FSM (RCFSM) 140. The RCFSM controls 
the entire router through control signals to the internal router modules 147. The 
RCFSM state diagram is shown in FIG. 13. 

The RCFSM is triggered from idle by one of three events: a processor request 
,0 read or write a router data structure 470. a blocked route request becoming 
unblocked 471 or an incoming route request received from a port control module 
Signal 472. The three events are prioritized in case of multiple simultaneous events. 
The priorities from high to low include: 1) processor request. 2) a blocked route 
request becoming unblocked and 3) an incoming route request. When a processor 
updates any of the router fields the rou«r must be in a quiescent state, i.e.. not 
updating any data strucmre. When a processor requests access to a router data 
stmcmre the processor signals the RCFSM by averting the BLKCTLREQ signal. If 
in idle the RCFSM enters the RTBLKED state 452 and waits until the processor has 
finished its access. While in the RTBLKED state the RCFSM signals it is in diis state 
bv asseitine the BLKCTLACK signal. The router processor interface logic will hold 
off the pro«ssor access via a WAIT signal until the BLKCTLACK signal is enabled. 

The remaining RCFSM diagram states and description is discussed below. 
Reter to FIG. 18 tor the state diagram and to FIG. 4 for the module description. 
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State 
DEQROUTE 467 

CLRJIF0 468 

DECODERRSP 455 

RTOK 456 

RTBSY 459 
RTRJT 460 

RTDISCARD 461 
RTWAIT^EOF 462 
10 RTBLK 463 

PGMSW457 
RTNRSP 458 
LDRTSTATE 464 

LD^RT 453 
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nescription 
Program RRS 137 to use the newly unblocked 
route request as an input 1 15 
Signal the BRTBL 133 to remove the blocked 

route 

Wail one clock for the RDM 138 to apply 
routing rules checks to the route request 1 10 
The RDM 138 has determined the route is ok. 
Signal the RST 139 to update the route table, 
signal the RSG 141 to collect statistics for this 
route and select the destination port from the 
ADM 131 results. 

The RDM 138 has deiemiined to return a tabnc 
busy (F BSY) frame to the sending port. Signal 
ihe RSf 139 to update the route table, signal the 
RSG 141 to collect statistics and assign the 
destination port from the source port (i.e.» route 
F BSY back to the same port). 
The RDM 138 has determined to rewm a fabric 
reject (F RJT) frame to the sending port. Signal 
the RSt139 to update the route table, signal the 
RSG 141 to collect statistics and assign the 
destination port form the source port (i.e., route 
F RJT back to the same port). 
The RDM 138 has determined that the port 
control module should discard the frame. Signal 
the RSG 141 to collect statistics. 
The RDM 138 has determined that the port 
control module should wait until the entire frame 
is received before resubmitting the route request. 
The RDM 138 has determined to block the route 
request. The BRTBL 133 and the BRRA 134 
are signaled to save the route request and save 
the port requesting the route. 
Program the switch core 123 to make a path 
from the source to the destination port. 
Signal the PCRRSPM 144 to remrn a route 
request complete indication. 
Signal the RST 139 to update its context and 
signal the BRTMR 104 to enable a blocked route 
request timer. 

Signal the RRS 137 to read the route request 108 
that was just read from the PCRRIM 130. 
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SOFOREOF 454 Sional the PCRRIM 130 to fetch another route 

the RRS 137 module. Load the route results 

from the RDM 138 into the PCRRSPM 144 (in 

caseJelimiicrisanEOF). Go to the 

DECODERRSP 455 state if the delimiter in the 

route request U an SOF otherwise go to the 

EOFDELIM 465 sute. 

EOFDELIM 465 Signal the RRS 137 to "^e the destiimion port 

from the route context m the Rbi i Jv. 

DISTIMER 466 Sienal the switch core to disconnect the path 
DISTIMER 4«) ^^.^ ^ ^^.^^^ ^^^^^ ^ ,^ ^^j,„,„„„ 

port, signal the RST 139 to update the route 
table context to reflect the disconnected path and 
signal the PCRRSPM 144 to i«mm a route 
request complete indication. 

E. Port Control 

FIG ' shows the Port Control (PC) locations 5 1. 70. 74. 75. within the fabr« 
hlock dia^ratn. Pn^ferably. ihere is one PC per port or link. The PC interfaces with 
,he fabric attached device through either copper or f.ber media 56. 77. 78. The PC 
interfaces to the switchcon. through transmit 58 and receive57 data buses and control 

signals The PC interfaces to the router through route request 59. 61. 66. 72 and 
rclte response 60. 62. 67. 73 buses and control signals. Finally the PC interfaces to 
the Fabric Control module through a processor interface bus 65. 

RG 5 shows the PortComrol in more detail. Frames are received from the 
fiber or copper Itnk 151 and enter the Endec 153. The Endec implements the 8B/10B 
encoding/decoding, the loop port state machine and fabric/point-to-point state machme 
functions and outputs thirty two bit data words with two bits of parity and tag 
information to the receive FIFO 155. The PC contams a module which guards against 
a receive RFO overrun 154 condition. Once the receive HFO 155 starts ftlUng. the 
Port Control Module (PCM) 156 reads the frame header, requests a route from the 
router 163. 164 and forwards the frame to the switch core 161 . 162. The PCM ts 
configurable by the processor 170 in the Fabric Control module. The Port Control 
also rece.ves frames from the switch core 165. 166 to be transmitted by the Endec 
153. 
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Pr.rt rnnirnl H "''"'-? 'P^M> 

FIG. 10 Shows the Port Control Module (PCM) in more detail. The PCM is 
responsible for read.ng a portion of the received header from the input FIFO 250. 
bu.ld,ng a route request for the router 262. 263, 264. 260. t«:eiving the route 
5 response from the router 265. 266. 261 airi either tbnvarding the frame to the switch 
core 249 or building a fabric reject (F.RJ-H or fabric busy (F.BSY) frame and 
forwarding those to the switch core. The PCM also performs miscellaneous ftinctions 
such as receive frame validation against parity errors, short frames, frames too large. 

tag errors and other checks. 
10 The PCM is composed of the following four modules: 

,1) Port Conm>l HFO Module (PCFIFO) 247 

(2) Port Control to Router 1/F Module (PCRTIF) 234 

(3) Port Control Main Control FSM (PCFSM) 232 

(4) Port Control Configuration/Counter Module (PCCFQ 233 

j5 I p»n rn,,fp^i FIFO mndiilr (PCFIFO) 

no. 10 shows the Port Control HFO module (PCFIFO) 247. The PCFIFO 
buffers several words of the incoming frame with internal registers. The registers 
include four general input registers (f.fo_regO 237. ftfo_regl 238. rtfo_«g2 239. 
fifo re<.3 240). five special input registers (sof.reg 241. rctldidjeg 242, type.reg 
.0 243" param r.g 244. eofjeg 245) and a main input and output register 
(EDATA OUTR236andSW.DATAIN246). The input register (EDATA_OUTR) 
«tes the data in from the input HFO 250 by asserting the FIF0RE(3_ signal. The 
output register sends the data to the switch core by asserting the SWACK. signal 249. 
The general and special input registers are loaded from the EDATA_OUTR register. 
^5 The general atxl special registers also are connected .0 a multiplexor which feeds the 
SW DATAIN register 246. The special registers allow the PCFIFO to build fabric 
reject (F.RJT) and fabric busy (F.BSY) frames and to insert special EOF delimiters 
when the route response 261 specifies to do so. 
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The reccved desiination address (D_ID) along wiih the SOF delimiter is wired 
to the PCRTIF module 254 to build the route request 260. Fittally the PCFIFO is 

controlled by the PCFSM 232. 

The PCFIFO module performs certain frame validations. These vahdations 
S include parity and tag field checking and reget^ration, CRC. invalid transmu word 
.„a link down while receiving frame validations. When .he frame validations ta.l a,e 
PCFIFO automatically inserts the appropriate EOF delimiter 251. either an EOFa. 
EOFni or EOFdti. 

The PCFIFO will build a fabric frame reject (F .RJT) when the route response 
10 from the router specifes to do so 261. The PCFIFO builds the fabric reject by 
changing certain felds in the frame header 241. 242. 244. Since the eruire header ts 
not yet in the PCFIFO internal registers a counter is implemented to indicate when 
,0 insert the modified header fields. The frame f.lds which are modified include the 
R CTL field 242. the parameter field 244 and potentially the EOF delimiter 245. In 
15 addition if there was a payload associated with the frame it is discarded. 

The PCFIFO will also build a fabric busy (F_BSY) frame when the route 
response from the router response specifies to do so 261 . The PCFIFO modifies ^ 
R cTLtleld242,thetypefield243ar«lpotentiallytheEOFdelinuter245. Asmthe 

F> frame modification the payload for the F_BSY frame is discarded. 

,Q 2 PTirr rn"""' Main rnntrol Mofliilr (PCFSM) 

no. 10 Shows the Port Control Main Control Module (PCFSM) module 232 
,PCM) The PCFSM controls the other modules which compose the PCM 252. 258. 
272. The PCFSM is triggered by a frame being received from the input RFO. HO. 
, I shows the PCFSM state diagram and is described in detail below. 

" IDLE ^ Wait until the first three words of a frame are received 

from the input FIFO. This is the first state after a 
system reset. . 
CLRSOF 302 A frame has been received. Reset the EOF register 
CLRSOF 30^ ^^^^ ^^^^ .J « not a 

siiori trame. 
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ROUTEFRM 303 

XMTFRM 304 
RTNRJTBSY 308 

WAITEOF 306 
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,„ ,his state the PCFSM signals the PCRTIF «> send a 
route request (RREQ) to the router. The PCFSM w.ll 
loop in ihis sutc until a route respoitfc (RRACK.) is 
received back ftotn the router. 
Transmit the frame through the Port Control from the 
input receive FIFO to the switch core. 
The router has determined that a fabric reject (F RJ D 
or fabric busy (F.BSY) frame should be femrned_ 
The SOF delimiter is modified along with the R_c i l 

w!?t until an EOF is received. The Port Control 
usually implements cut through routing, i.e.. when a 
frame is received it is forwarded to the remote before 
the end of frame is received. Certain conditions 
dictate that the frame should be received ii» its enurety 
before being forwarded. An example condiiion 
includes the remote port speed is lower than the 
source port. 

Signal the PCRTIF to send a route discoraiect request 
(RREQ) and loop in this state until a route 
disconnected response (RRACK) sigi^l is received^ 
This one clock slate is entered into after transnutting 
or discarding a frame. If a Class 2 or Class 3 frame 
was operate? on the Endec CREDIT s,gnai « puk^ 
The EOF register (RESET.EOF) is clear«l.tte frame 
counter is cleared and the EOF in received HFO 
counter is decremenied. 

wait until an EOF is received f^;^^'^^ ' 
F RJT/F BSY frame bemg returned. An EOf musi 
received so as to not cause a transmitter underrun 
ai the remote Endec, 

Wait until an EOF is transmitted which signalsttat 
the F RJT or F_BSY EOF was transmitted. While in 
the XMT FRJTBSY state assert either the xmtjrji or 
xmt Jbsy'signal to the PCFIFO module to specily 
which frame to transmit. 

HGlOshows the Fort ControlConfiguration/Counter(PCCFG)mod«le233. 

The PCCFG maintains counters and provides the processor interface 271 to the Port 
control Module. The PCCFG contains an EOF received counter 267. a current frame 
count reaister 268 andaport control configuration register 269. The EOF received 
counter "keeps track of the number of fti.l frames received by the Endec contamed m 
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UPDATE_CDT 
306 



WAITEOFI 309 
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^ ran. F,FO. Th« — f,-« — "O-i"" *= 

'""""the port c«.llS«™*» "= *^ 

Indicates the maximum receive 
frame size in words 
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Max Frame Size 
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LISM Mode 

Clear Interrupt 

Pulse CDT^ line 
Clear Inierrupi 
Enable Remote 
Port Routing 
This Port Number 
EOF Counter 

Frame Discarded 

Frame Too Short 
Detected 
Frame Too Big 
Received 

Tag Error 
occurred 
Parity Error 
occurred 
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U 

12 
13 
14 

19:16 
26:24 

27 

28 

29 



30 
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miu^ ' 

The Port is currently going through 
loop initialization indication 
Clear the bad parity notification 
interrupt. 

Pulse the Endec credit line. 
Clear interrupt latch 
Enable preemptive remote port 
routing. 

Counter value for the number of EOF 
delimiters received from the Endec. 
Frame was discarded by the Port 
Control. 

A frame which was less than eight 
words in length was received. 
A frame which was greater than the 
specified maximum frame size (bus 9 
10 0) was received. 

A tag error was detected (i.e., a tag 

of either 00 or II). 

Clear parity iniemipt indication 

register. 
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the PCMs. The route response is received over 



15 



FIG 5sbows.l«FIFOO«n»»Pr««nonUgK'fO'^'" 

u crkDi miKt hand e is when the »anic 4iii>^ 

U« TAG bta 154 n« *e d» »« ^ ^„ «„ M wo* «, «» 

,cim Alonl •Ml the *ln(t»oW 
b» p»i>y I**"- ™ ' bi. «oris "> i'*""' 

Mm *e Eirfec IK FOPL «i> *= -S ™ bte. Tte ilfcpl »» 

::rrr.-r.r:»--— 

aelimiier. interfaces with the 

pir R shows the FOPL in more dettil. The run- 
FiG.Sshowstnc .„^nMArequestsiei«il203.andtheEndec 

5 Endec tag bits 202. the E.dec recetve fntn« DMA eq^ - 

. nMAacknowledgcmeW 204 signal. The FOPL interlace 
receive frame DMA actoowledg ^jfoNOTEMPTY 206 signal. 

FIFO by supplying the tag btts and ^^^^ ' the value of the 

OunngnoonaloperationthePOPLwUlsetthePIPO^^^^^^^^^^^^ 

H.ecta.bitsZ0.Wh.thenPOis...^^^^^^^^^^ 

30 206 is deasserted. the FOPL will output an illegal 
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n 0^^^^^^^ Siena. 206 isassened a^.hcn..«t a word wuhbad 
unul .he „ 3-^^, ^his las, scenario ha«..es the case 

b.ts by asserun, the HFOWmB ^ . ^^^^^ ^^^^ ^ 

where the last word received overflows the 



receive. 



^^Ba a^rt>i r ra ti on Iflgi ciEPAU ,„,:,,pDAL) 1 57 within the 

nr. 5 shows the Processor/Data Arb.trat.on Logic (PDAU 
FIG. . shows ^^^^^ j^^^ ^.^ ^ 

P<„t control area. Smce the Endec 153 muU.p 

^ . V ic npwled to arbitrate between processor av,tc»». 
registerconfiguraiionbus. logic tsneededtoar ^.^ ^age 

„ frames bcine transmitted from the switch core 166. Ihis i g 
0 and ^-•^•"^'"^ " ^^^,,.,,3:eslower.hantransmitdauworddma In 
processor accesses to the Endec w ,o the Endec 

.Hl^rwordsttaframeiscarrentlybeinguansmc^d.^--^^^^^^^^ 

...heldo«.nt..e.er.e.me— _ ^^^^^ ^ 

transmit FIFO is Ml. allowmg enough tune for P 

15 transmitter undemin occurs. ,^^«,r accesses and transmit daa 

,5 IM.MIIJI"""™"-- * Th,„«,c.s»)t»ai only accss the En« 
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access 10 the Endcc internal registers beJore the Endec 
empties. 

gj^j^jaaciJiut^lffiii^ The PCHM extends 

FIG 29 shows the Port Control Hub Module (PCHM). The ^ 

. n3,itv of the Port Control Module by adding several Ftbre Channel 
,he tuncttonahty ot the ^ ^.^^^^ ^^.^^ 

..hitracedLoopHubports m - -^ 

over multiple anacheddevu^s 705. All attache Endec is 

«^ the switch through an internal Endec iw. inc 

„ v««s«' VSC7120. 

P„„ B,p«s Crcu. (PBC>. « 

oi- ^"'"7 "Ir- ». c«»™w b, a« «= 

• ""^r " THis *.s «. « «»o. ™-u.e » 
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«now for increased performance per loop and 
Segmenting loops to allow for increas 

greater inununity from loop failure 
Allowing tor ho. pluggable hub boards 
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Leveraging the switches SNMP ne,wor. management capability for 
greater control and monitoring of the loop. 

F. ^^^^ a 

FIG ■> and 6 shows the Switch Core. 

:» «.! « Br«r M.1U1. TO. 2 mnml 76. The ™«cb c 

„^ " 

Although tfK foregoing invention has been descnoea 

^ example for ^rposes of clarity a«. understanding, .t may be read ly 

apparent to ^ '""^ ^ ^ae thereto without departing from 

that certain changes and modificauons may 
the spirit or scope of the appended claims. 
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I Claim 



, . A fibre channel switching fabric for connecting multiple attached 

devices comprising: 

™u.ple port comrol modules, the port control modules being adapted 
for cotttmunication with the attached devices, the port control module 
ftit^tiomng to build a route request and read a route response. 

. router nuKlule. the router module being connected to the pon control 
^„,cs by a route request connectiott and by a separate route response 
connection, and 

a switch core, the switch core being conne«ed to the port control 



modules. 
2. 
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, The fibre channel switching fabric of claim I for connecting multiple 
attached devices further including a fabric control module connected to the .outer 
module and port comrol modules. 

3 The fibre chani^l switching fabric of claim 1 for connecting multiple 
...ched devices Wherein there is one portcontrol module R,r each attached dev^. 

4 The fibre channel switching fabric of claim 1 for connecting multiple 
...acheddevices Wherein at least one portcontrol module is attached toaarbitrated 

loop having multiple attached devices. 

5 The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein the port control module farther serves to modify frames. 

6 The fibre channel switching fabric of claim 1 for connecting multiple 
attached devices wherein d.e port control module modifies frames to fabric frame 
busy (F_BSY). 
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7 The nb« channel swUching fabric of daim I for connecting multiple 
auached device, wherein the port control module modiftes frames to fabric frame 
reiect (F_RJTV 

8. The fibre channel switching fabric of claim I wherein the pon control 
module further funcuons to discard frames. 



9 The fibre channel switching fabric of claim I for connecting multiple 
attached devices wherein the port control module performs frame validafon. 

10 The fibre channel switching fabric of claim 9 for connecting multiple 
attached devices wherein the frame validation includes parity error validation. 

11 The fibre cham«l switching fabric of Cairn 9 for connecting multiple 
attached devices where,n the frame validation includes invalid transmit word 

curreciion. 

12 The fibre channel switching fabric of claim 9 for connecting multiple 
15 attached devices wherein the frame validation detects frame size error. 

13 The fibre channel switching fabric of claim 9 for connecting multiple 
attached devices wherein the port control module ftttther performs frame connection. 

14 The fibre cham«l swUching fabric of claim I for connecting multiple 
anacheddevices whe^inthe fabric isconnectedinadirect fabric attached topology. 

,3 The fibre channel switching fabric of claim I for connecting multiple 
.rached devices wherein the fabr. is cor^ted in an arbitrated loop attached 
lopology. 
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V f,hrir of Claim 1 for connecting mulupte 
ifi The fibre channel switching fabric ot Claim I 

. .H^cheddevlcesinciudefibrechanmlcompUantdevices 
.ucheddeviceswheremtheaaacheddevKres. ^ ^^^^^^ 

selected tVotn .he group comprising: a mainframe, 
computer, a storage device and a disk array. 

r u «f riaim I for connecting multiple 
.7 The fibre channel switching fabric of claim 1 for 

^ ,i»«ire<i include a second fabric, 

attached devices wherein the atuched devices includ 

. r u V «f claim I tor connecting muliipte 

18 The fibre channel switching fabric of claim tor 

• h.«.ntheswitchcorecomprisesafi.llcrossbar. 
attached devices wherein the swticn 

K- „ f,hric of claim I for connecting multiple 

19 The fibre channel switching fabric otcuun 

10 attached devices h^rther including a bridge module. 

• u- »f,hric of claim 1 for connecting multiple 

20 The fibre channel switching fabric of claim 
attached devices further includmg a hub module. 

... f K,ir nf claim I for connectmg multiple 

attached devices wherem the attached devwes 



15 link. 

22. 



. rwrirnf claim 21 for connecting muluple 
The fibre channel switchmg fabric of claim 
attached devices Wherein the linlcisacop^connection. 

,3 Tl.nbrec.»««lswitchingfabricofclaim2Iforconnect.gm^tiple 

attached devices wherem the Unlc is a fiber optic connection. 

24 Thefibrecha^^lswitch^gfabricofclaimlforconnect^-^^^ 
attacJde-w.reinthefabncreceivesn^^^ 

gigahertz. 
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■ 15. The fibrechannel switching fabric of claim I for conrHXtingm 
attached devices which supports Class 1 service. 

26. Thef-brechannelswicchir^gfabricof claim I for connecting multiple 
attached devices which supports Class 2 service. 

,7. The fibre channel switching fabric of claim I for competing multiple 
attached devices which supports Class 3 service. 

28 The nbre channel switching fabric of claim 1 for connecting multiple 
«.ched devces which supports each of Class I . Class 2 and Class 3 service. 

29. The fibre channel switching fabric of claim 28 for competing multiple 
,0 attached devices which further supports intermix service. 

30 A tt^thod for scrvici^ route requests from multiple attached dev.. 

..„hiect to blocked and unblocked conditions, the method 
where the routing is subject to oiocneu 

comprising the steps of: 

apitalion of a f""'' 

20 cleared. 

p m med^od of Claim 31 wherein the saved information regarding the 
blocked route request includes the requesting pon control module port. 
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33. The method of claim 31 wherein the saved information regarding the 
blocked route request includes a matched destination port control module port. 

34. The method of claim 31 wherein the saved information regarding the 
blocked route request contains the blocking condition. 

35 The method of claim 31 wherein the saved information regarding the 
blocked route request .ncludes the indication of an end of frame delimiter being 
received by the requesting port control module port. 

36. The method of claim 31 wherein the saved information regarding the 
blocked route request includes a delimiter in the incoming frame. 

10 37. The method of claim 31 wherein the saved information regarding the 

blocked route request includes whether there was an address match. 

38 Themethodofclaim3l wherein the saved information regarding the 
blocked route request includes whether to route to the fabric por. comrol module. 

39 The method of claim 3 1 wherein the saved information regarding the 
15 blocked route request includes whether a fabric reject frame (F.RJTl is to be 

generated. 

n TO«l«eoteUlm3lwl««n4e«v«iMormad(».r<prdlns«» 

bK«K». ™k «^ • "-^'^ " " 

generated. 

4, A mr. ctonnd lib™ f« «»««ai"8 """iP" 

attached devices, comprising: 

multiple port control modules, the port comrol module bemg adapted 

for connection to an attached device. 
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a router, the router being m communication with the port control 
module, to receive route requests and to generate route responses and to 
provide the route responses to the port control modules, the port control 
modules being connected to the router by separate route request connections 
and route response coniKCtions. and 

n sinele switch core for support of connection based service netween 
attached devices and connectionless ba«d service between attached devtces. 



42. 



The ftbre channel fabric of claim 41 for connecting multiple attached 
aevicesLher including a fabric control, the fabric conuol in communication with 
10 ihc port control modules. 

43 The fibre channel fabric for connecting multiple attached devices of . 
clahn 41 Wherein the single switch core is a non-blocking switch core. 

44 The fibre channel fabric for connecting multiple attached devices of 
claim 41 wherem the dedicated connection is maintained in the switch core unttl a 

15 removal request is received. 

45 ^ fibre channel fabric for competing multiple attached devices 
supporting connection based service and connectionless based service between 

attached devices, comprising: 

multiple port control modules, the pon control module being adapted 

-yQ for connection to an aiuched device, 

a router, the router being in communication with the port control 

modules to receive route requests and to genente route restK>nses and to 

provide the route responses to the port control modules, the router 

constructing a route in two microseconds or less, and 
,5 a single switch core for support of connection bases service between 

attached devices and com«ctio«less based service between atuched devices. 
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46 A nbre channel fabric for connecting multiple attached devices 
supporting connection based service and connectionless based service between 

auached dcv ices . comprising: 

multiple port comrol modules, the port control module being adapted 

5 for collection to an attached device. 

, router, the router being in communication with the port control 
„,odules to receive route r«,uests and to generate rouu. responses and to 
provide the route responses to the port comrol modules. Che router including 
n^ulUple sute machines which result in pipelined operaUon for handling route 
,0 reouests and route responses, and 

a single swhch core for support of connection bases service between 
attached devices and connectionless based service between atuched devtces. 

47. A fibre cham«l swixhing fabric for connecting multiple attached 
-icescompr-^in.^^^^^^^^^^^^^^^^^^^ 

connection for communication with att^hed devices, a route request 
eenerator. and a route request response receiver. 
" a rou«r, the router including an input for receiving the output of the 
.oute request generator of the port control modules, an output for sending a 
.0 route request response to the route request response receiver m the port 

contro.module.ahardwarennitestatemachinetoreceive.hcrouterequest. 

arKl a hardware ftnite state machine to provide the route response, the router 
fi^rther including a route determination system which determines a route 
within a single clock cycle of the system, and 
25 a switch for selective inte,con,«c. of the port control modules. 

48 The fibre channel swiu:hing fabric of claim 47 for connecting multiple 
aruched devices wherein the router cont«,l includes a hardware finite state machtne. 
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■ 49 The Hbre channel swkching fabric of claim 47 for connecting multiple 
attached device, wherein the single clock cycle is 30 nanoseconds or less. 

50. An .nvroved port control tnodule for use in a ftbre channel switching 

fabric comprising: 
, an input/output port for connection to a link. 

an encoder/decoder in cotnmunication with the input/output port, and 
a buffer, 

,hcimproven««comprising*c-.nch.sionofb«fferoverrunp«vennon 

logic between the encoder/decoder and the buffer. 

5. Theimprovedportcontrolmoduleforuseinanbrechannelswitching 

fabric of claim 50 wherein the buffer is a first-in. ftrst-out buffer. 

5, Theimprovedportcontrolmodu,eforuseinaf.b.channelswi.ching 
...cof^la^ 50 where^ebufferover^nprevention logic sets tag bits toau^que 

valve indicative of an overrun conditions. 

53 ^ n^thod for control of an input buffer, where the input buffer is 
aaaptcd to receiveastream of data atarate Which is not subject tocontrol by the 

buffer, comprising the steps of: 
receiving the data, 
placing the data in the buffer, 
monitoring for an overflow condition, 

4 .c HPf«^cted including a delectable signal 
and if an overtlow condition is deiecteo, mtiuu 5 

in association with the data, and 

. A fwxm the buffer and the detectable signal to 
providing the data from the t)uner diiu 

subsequent devices. 

54. Tl.me.hodofc.aim53forcontrolofani«putbuffer.thedetectab,e 
condition comprising tag bits. 
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55. m »c*od of daim 54 for conuol of an input buffer wherein the tag 
bits are set to a unique condiiion. 

56. A nbte Channel switching fabric for connecting multiple attached 

devices, comprising: . ^ 

„,ultiple port control modules, the modules bemg adapted 

conmtunicalion over links to the attached devices. 

a router connected to the port control modules, the router mcludutg. 
a port control route request state machine, 
a port control route response sute machine, and 
a route determination module, 

the port control route request state machine, the route 
determination module and the port comrol route response su« 
„.chine connected in a serial manner for pipeline operation, and 
a swiu:h connected to the port control modules and the router. 

57 The fibre channel swiu:hing f^ric of claim 56 for connecting multiple 
control modules and router. 

.,nd«d *vi» t»«lKr inctudi^ . rc« c»«l « mad*. 

^ ^-^ ^ ^ ^ ^ rr^ 

a..^ .««.n m ^ ■« "°«^ " " 

25 round-robin arbitration selection unit. 
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■ 61 Tl« fibre channel switching fabric of claim 60 for connecting muUiple 
.„3ched devices Wherein .he por^concrol modules are connected .0 the port co™^^ 

,ou.e request state machine byashared route request datacl^nnel^^ 

request coimeciions. 

6-. The fibre channel switching fabric of claim 61 for connecting multiple 
attached Liceswhereintheselectionunitandthe route request statemachineprov.^^ 

a signal to the port control module which has been selected. 

63. A communication system for connecting multiple attached devices 
comprising: 

10 



5 



15 



a 

router 
and 

an 



multiple port control modules, 
a router connected to the port control modules, 
a switch core connected to the router and the port control modules, the 
providing selective interconnection between the port control modules. 



arbitrated loop adapted to connect to multiple attached devices, the 
arbitrated loop being competed to a port control module. 

64 K method for handling bloclced route requests in a communications 
system, wherearouterequest^^des at ^tadestina.ionaddress.asourceaddress 

and priority information, comprising the steps of: 
2Q receiving the route request. 

determining if the route can be completed, 
if the route cannot be completed, storing the route request, 
determining when to etTecmate the rou. indicated by *e route request 
based upon the priority and state information, and 
,5 . completing the route when indicated by U« time condition a«i the 

priority condiiion. 
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65 The meihod for handling blocked rouie requests in a communication 
system of clam.*^ wherein the priority information is from the group comprising: 
Class L Class 2 and Class 3 service. 
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AMENDED CLAIMS 

.^eivedby mc .me,n«iona. Bureau on .8 ^ep.-^' »'^;^°J:'«>- 
' originaJ 1 and 56 amended: new cluuns 66 and 67 added, 
remaining claims unchanged (3 pagcs)l 

I. A fibre cb«>wl switching fabric for connecting multiple attached 

5 for commumcation with the a«ach«i devices, .he pon con«l module 

fonctiomngtobuUdaTOttterequestandrc^iawuierespoMe. 

ah«Jwareiou.er«odule.iherom»oddebeiagcon«c.adtomepart 

co„^l„»d«lesbya.cu.er^uestco»nccdon«Klbyasn.««e«>-««^^^ 

connection, and ^ .^„tr.vi 

a switch core. Oie swiud. core being connected to the port control 

modules. 

^'a.v,=« M« ""^^ '-^ " 

15 module and port control modules. 

3 The fibre channel switching fabric of cl«« I for «>m»ecting multiple 
.^eddeviceswhereinthcreisoneportcontrolmoduleforeachatt^^ 

4 Thcfibrechannelswitchingfebticofdaimlforconnectingmultiple 
a^deviceswhereuiatleastcneportccmrolmodulcisatt^^ 

having nwltiple attadied devices. 

5 Thefibrecha«.elswi.chingfabricofcl«ml forconnectingmultiple 
,5 .rucheddevice,whereintheportcoo«ln«dulefi»iherserve.tonu.diiy^^^ 

6 The fibre channel switching fabric of claim I for connecting multiple 
anacheddeviceswhereintheportcon^lrnodulemodifiesftam^^ 

(F.BSY). 
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55. ThemethodofclaimSAforconwlofMiinputbufferwheremthettg 
bits are set to a unique condition. 



56. 



10 



15 



20 



25 



A fibre channel switching fabric for connecting muUiple attached 

devices, comprising: 

multiple port control mcddc^ the modules being adapted for 

communication over links to the attached devices. 

a hardware router connected to the port control modules, toe router 

including: 

a pott control route request state machine, 
a port control route response state machine, and 
a route det«nunation module, 

^ port control route nquest state machine, the route 
determinaiiontnoduleairithepori control route response state m^ 
connected in a serial manner for pipeline operation, and 
a switch connected to the port control modules and the router. 

57 The fibrechannel switching fabric of claim 56 for connecting multiple 
attached devices fl«herincl«dinga&briccon.rol,ysremco«^ed.o.he^ 

nodules and router. 

58. The fibrechanncl switching fabric of claim 56 for connecting multiple 
attached devices fijrther including a router control state machine. 

59 ThefibrecbamtelJwitchiiigfabricofclaimS6forcoDnectingmultiple 

atuehed device, wherein theportconuol route request state machiM 

robin arbitr^ionselectionunitwhicbtscomiected to the port comrolmodules. 

60. The fibre channel twitching fabric of claim 59 for comiecdng multiple 
attxheddeviceswheteincachponcon.rol.nodutoissq«3telyco«^ 

robin arfaitraiion selection unit 

AMENDED SHEET (ART1CLE19) 
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•65. TUt method for handling blocked route requests in a conmunieation 
system of claim 64 wherdn the priority infermation is ftom the group comprisii^g: 



10 



Class I, Oass 2 and Qass 3 service. 



66 The fibre channel mtching fabric of claim 56 for connecting multiple 
anached devices whereintheroutedetemunarionmoduleisin^lemeo^d 



67. A 



fibre channel switching fabric for connecting multiple attached 



13 



devices comprising: 

multiple port control modules, the poncoittrol modules being adapted 

for communication with the attached devices, the pott conhol module 
functioning tobuildaroutc request and teadaroute response. 

aroutermodule.thewutetmodulebeingcom»ctedtotbepoitcontrol 

niodule, by a route «quest co».ecdon and by a sep.r«e m«e response 
connecdoQ, and 

a singte switch core supporting each of Class I. Class 2 and Class 3 
service, theswitch core beingcomiected to theponcontiolmodules. 
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